Duncan and Murray BMC Health Services Research 2012, 12:96 
http://www.biomedcentral.eom/1 472-6963/1 2/96 



^BMC 

Health Services Research 



RESEARCH ARTICLE 



Open Access 



The barriers and facilitators to routine outcome 
measurement by allied health professionals in 
practice: a systematic review 



Edward AS Duncan" and Jennifer Murray 



Abstract 

Background: Allied Health Professionals today are required, more than ever before, to demonstrate their impact. 
However, despite at least 20 years of expectation, many services fail to deliver routine outcome measurement in 
practice. This systematic review investigates what helps and hinders routine outcome measurement of allied health 
professionals practice. 

Methods: A systematic review protocol was developed comprising: a defined search strategy for PsyclNFO, 
MEDLINE and CINHAL databases and inclusion criteria and systematic procedures for data extraction and quality 
appraisal. Studies were included if they were published in English and investigated facilitators and/or barriers to 
routine outcome measurement by allied health professionals. No restrictions were placed on publication type, 
design, country, or year of publication. Reference lists of included publications were searched to identify additional 
papers. Descriptive methods were used to synthesise the findings. 

Results: 960 papers were retrieved; 15 met the inclusion criteria. Professional groups represented were 
Physiotherapy, Occupational Therapy, and Speech and Language Therapy. The included literature varied in quality 
and design. Facilitators and barriers to routine outcome measurement exist at individual, managerial and 
organisational levels. Key factors affecting professionals' use of routine outcome measurement include: professionals' 
level of knowledge and confidence about using outcome measures, and the degree of organisational and peer- 
support professionals received with a view to promoting their work in practice. 

Conclusions: Whilst the importance of routinely measuring outcomes within the allied health professions is well 
recognised, it has largely failed to be delivered in practice. Factors that influence clinicians' ability and desire to 
undertake routine outcome measurement are bi-directional: they can act as either facilitators or barriers. Routine 
outcome measurement may only be deliverable if appropriate action is taken at individual therapist, team, and 
organisational levels of an organisation. 
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Background 

The current economically challenging climate of the devel- 
oped world has seen significant restrictions being placed 
on professionals and services [1], the requirement for clini- 
cians to demonstrate the impact of their practice has never 
been more vital [2] . One way to achieve this is through the 
routine measurement of patient outcomes. Outcome mea- 
sures are assessments that measure change in patients 
functioning, performance or participation over time. Rou- 
tine outcome measurement is strongly mandated for in na- 
tional health policy [3,4]. However, despite continued 
professional appeals [5,6] this standard has remained 
largely aspirational with little evidence of routine outcome 
measurement in allied health professional practice, and 
continued evidence of ambivalence towards outcome 
measurement by staff [7-11]. Whilst this position has 
never been professionally justifiable, it existed and was, ar- 
guably, tolerated in a period of economic growth and clin- 
ical service expansion in the NHS (UK) and beyond. These 
times have past, and without strong evidence of impact al- 
lied health professional services are vulnerable to closure 
[1]. Routine outcome measurement is now, therefore, es- 
sential, as it is through such measurement that service im- 
pact can be evidenced. 

There are several reasons to promote the use of rou- 
tine outcome measurement in practice. Without routine 
outcome measurement clinicians receive little feedback 
on the types of outcomes that they achieve and on how 
these outcomes compare with other health professionals 
[12]. Records of patient outcomes also enables progress, 
which can sometimes appear intangible, to be effectively 
communicated to patients; and also promotes efficient 
treatment planning [12,13]. Routine outcome measure- 
ment can also be used to support the clinical justification 
of interventions, and provide important supporting evi- 
dence to healthcare funding bodies [2]. 

Despite these reasons, routine outcome measurement 
has largely failed to become embedded in practice 
[7,9,11]. Trauer and colleagues [14] gave an indication of 
why this may be when they highlighted that resistance is 
a common reaction to innovation and change in health 
services' routine practice. But after 20 years of trying to 
embed routine outcome measurement into the practice 
of allied health professionals, the argument that it is due 
to change and innovation alone is insufficient. It is ne- 
cessary, therefore, to examine why it continues to prove 
such a challenging issue. 

Some research into the barriers and facilitators of rou- 
tine outcome measurement has already been conducted. 
In an unstructured review of the literature [15], cost, 
practicality, clinical relevance and a lack of knowledge 
over which outcome measures to choose were high- 
lighted as potential barriers to their routine use in prac- 
tice. Potential facilitators were highlighted as ease of 



administration, speed of administration, measures that 
were easy to score and provided useful clinical informa- 
tion. In a more rigorous review in mental health services 
[14], staff concerns relating to routine outcome measure- 
ment were grouped into five domains: access to appro- 
priate technology and ability to use it; appropriateness of 
instruments; time burden; suspicion of management or 
government motives; and competence and confidence in 
using outcome data. Patterns of issues are evident across 
both these papers and it is intuitive that some of these 
issues may also be relevant to the allied health profes- 
sions. Yet, other unidentified issues may also play an im- 
portant role. A comprehensive review of the literature 
pertaining to routine outcome measurement in the allied 
health professions is therefore warranted. 

Methods 

This review aimed to address the question: what are the 
barriers and facilitators to routine outcome measurement 
by allied health professionals in practice? Few studies de- 
fine what they mean by routine outcome measurement 
in practice. This study adopts Colquhoun and colleagues' 
[7] recent definition of routine outcome measurement 
as: "the systematic use of a standardised outcome meas- 
ure^) in clinical practice with every patient as a part of a 
standardised assessment practice guideline" (p.49). Out- 
come measures can be completed by either the patient 
or a therapist. This study includes both. A systematic lit- 
erature review was conducted using an explicit search 
strategy to retrieve relevant publications. The review's 
methods, search strategy and inclusion criteria used to 
identify relevant papers conform to established system- 
atic review procedures [16]. No restrictions on profes- 
sional group were applied at this stage in order to 
maximise the search's sensitivity. As the identified litera- 
ture was heterogeneous, a modified narrative synthesis 
[17] framework for mixed-methods reviews was applied 
during the quality appraisal, data extraction, analysis, 
and synthesis stages. The search strategy involved elec- 
tronic searches of the electronic bibliographic databases 
MEDLINE (1966-2010), PsycINFO (1967-2010), and 
CINHAL (1982-2010) for published work. The search 
strategy comprised of two search filters: 'outcome mea- 
sures' and 'facilitators and barriers'. The 'outcome mea- 
sures' search filter was adapted from the published 
search strategy of Gilbody, House and Sheldon (pp.91- 
96) [18] who investigated outcome measurement in psy- 
chiatric research and practice. The 'facilitators and bar- 
riers' search filter was developed in a series of iterations 
by both authors. The search strategy filters comprised 
relevant terms and synonyms combined with the BOOL- 
EAN operator "OR" and were then combined using the 
BOOLEAN operator "AND". Detailed information on 
the search terms can be consulted in Additional file 1. 
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Additional papers were sought by hand searching the 
reference lists of papers which were included in the re- 
view. Retrieved papers were included if a) they were con- 
cerned with identifying or researching factors which 
acted as facilitators and/or barriers in the routine use of 
outcome measures by allied health professionals in prac- 
tice; and b) were published in English. No restrictions on 
year of publication, type of outcome measurement, study 
design or publication type were applied. Papers were 
excluded if a) the topic covered was not of direct rele- 
vance (e.g., validating or standardizing an outcome meas- 
ure, whereby the perceived facilitators would be largely 
theoretical and applicable to the trial of the particular 
measure alone); b) the sample was not clearly defined 
(e.g., where only a general term such as 'clinicians' was 
used); or c) if the sample was not composed wholly of al- 
lied health professionals, those being: arts therapists, 
chiropodists, podiatrists, dietitians, occupational thera- 
pists, orthoptists, physiotherapists, prosthetists, ortho- 
tists, radiographers, speech and language therapists. 

Included papers were first categorised into six mutually 
exclusive domains [19]: quantitative research; qualitative 
research; mixed methods research; conceptual paper; 
opinion or literature review; practice based project or 
audit. Within each of these categories, the quality of each 
paper was assessed by one of the authors using a de- 
scriptive checklist based on the Centre for Reviews Dis- 
semination and Research [16]. Quality appraisal was 
checked and confirmed by the other author and any dif- 
ferences were resolved following discussion. 

Following published thematic analysis guidelines [20] 
and narrative analysis guidance [17], key factors were 
identified and extracted from each paper into a summary 
table by one of the authors (JM). Factors were then com- 
pared with each other to identify higher level themes. 
Themes were composed of factors that had occurred in 
several papers and/or mirrored themes already found in 
the general literature about barriers and facilitators to 
ROM. Themes were refined and synthesized through 
critical discussion between the authors until an agree- 
ment on the final themes was consensually reached. 

Paper inclusion, quality appraisal, data extraction and 
data synthesis were undertaken by one of the authors 
(JM). JM identified 14 papers (of the final 15 included) 
to be included in the review. Of these 14, five were ran- 
domly selected [7,21-24] to blindly assessed for match 
on emerging themes by the other author (ED). Agree- 
ment was 100%. Of the remaining papers (not included 
in the review), a sample of 11 were blindly assessed for 
inclusion/exclusion. Of these, six were elected for pos- 
sible inclusion by JM based on sample or possible suit- 
ability to the review's aims. The other five papers were 
selected at random. Of the five random papers, agree- 
ment for exclusion from the review was 100% between 



the authors. Of the six papers selected for possible inclu- 
sion, following discussion, both authors agreed that one 
of the papers [9] fit the review's requirements for inclu- 
sion. While agreements on papers were clearly high, any 
disagreements were resolved through discussion and 
clarification. 

Results 

Volume, nature and frequency 

960 titles and abstracts were retrieved from the elec- 
tronic database searches, and screened for inclusion. Of 
these, 54 papers were judged to be potentially relevant to 
the current review's criteria and were subjected to full re- 
view. Twelve of these were deemed relevant to the inclu- 
sion criteria. A list of papers excluded from the review at 
this stage can be found in Additional file 2. 

Five duplicate papers were removed and the remaining 
papers' reference lists were subjected to scrutiny for 
sources that may have been missed in the original 
searches. Eight additional papers were identified follow- 
ing this reference list scrutiny and a total of 15 papers 
were retained for review (Figure 1). 

All of the included papers were research based, with 
eight quantitative in design, four qualitative and three 
using mixed methods. Three of the studies were con- 
ducted in the UK and Ireland, three in Canada, two in 
the US, one with a mixed sample from the US and 
Canada, two in Australia, two in New Zealand, one in Is- 
rael, and one in the Netherlands. A higher number of 
papers were published in 2008 (n = 5; 33%) than in any 
other year (Figure 2). No link to country of origin was 
present in relation to this spike as all five of these studies 
were conducted in different countries and across 
continents. 

Scope and quality 

Of the 15 included papers, nine used a sample of phy- 
siotherapists, two used a mixed sample of physiothera- 
pists and occupational therapists, two used a sample of 
occupational therapists, one used a sample of speech and 
language therapists, and one used a mixed sample of oc- 
cupational therapists and speech and language therapists. 
Five papers investigated allied health professional man- 
agers or directors, seven investigated a general staff sam- 
ple and two investigated a mixed manager/ staff sample; 
one paper did not define whether their sample was staff 
or managerial. In total, 2161 allied health professionals 
participated in the reviewed studies, with the majority 
(N = 1450) being physiotherapists; see Additional file 3. 
Based on the quality appraisal, the papers were generally 
found to be adequately conducted, but several papers 
had various limitations (see Additional file 3). In general, 
the qualitative and mixed-methods papers' were found to 
be more methodologically rigorous. Quantitative papers 
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960 records identified through database searching: 

• 618 MEDLINE 

• 209 CINAHL 

• 133 PsycINFO 



906 rejected after 
appraisal of title and 
abstract 



54 papers retained for full text assessment: 

• 30 MEDLINE 

• 14 CINAHL 

• 10 PsycINFO 



12 papers included in review: 


• 5 MEDLINE 




• 6 CINAHL 




• 1 PsycINFO 





42 rejected after 
appraisal of full paper 



5 duplicate papers 
removed 



7 papers included in review 




r 



15 papers included in 
actual review 



8 papers identified through 
scrutinising included papers' 
reference lists 



Figure 1 Process of paper identification and selection for review. 



were of mixed quality. Several of the quantitative papers 
were unclear about their sampling in terms of sample 
size justification [21,25-28]; power analyses were only 
reported in one of the quantitative papers [17]. Many of 
the quantitative papers used simple descriptive analyses. 

Themes and concepts identified 

A range of barriers and facilitators to routine outcome 
measurement by allied health professionals in practice 
were identified. The majority of the papers included in 
this review identified barriers to routine outcome meas- 
urement. Only one of the papers [21] focused their 
wording positively and consequently received more detail 
about facilitators. Five papers [21,22,29-31] reported 
facilitators and barriers as a continuum. Four higher level 
themes were identified: Knowledge, Education, and Per- 
ceived Value in Outcome Measurement; Support/Priority 
for Outcome Measure Use; Practical Considerations; Pa- 
tient Considerations. 

Knowledge, education, and perceived value in outcome 
measurement 

This theme is composed of factors relating to outcome 
measure use at the individual clinician level. Eleven 



papers identified issues relating to clinicians' knowledge 
as influencing routine outcome measurement usage. 
Eight papers [22,23,25-27,30,32,33] identified clinicians' 
lack of knowledge about outcome measures' reliability 
and validity as barriers to their use; whilst three papers 
[21,29,31] suggested that greater knowledge, understand- 
ing and familiarity of outcome measures' increased the 
likelihood that they would be used in practice. One 
paper found that the use of outcome measures' was more 
positively viewed by those with a Masters level qualifica- 
tion [12] and another identified that those who had a 
clinical specialty, as opposed to those who did not, were 
twice as likely to use outcome measures' in practice [22] . 
The level of clinicians' perceived value of outcome 
measurement use was discussed in seven papers 
[21,22,26,29-32]. Four of them recognised that this factor 
was bi-directional [21,29-31]. A lack of perceived value 
of outcome measures lead to a decreased likelihood of 
their use in practice, whilst greater perceived value 
appears to increase uptake. 

Support and priority for outcome measure use 

This theme relates predominantly to the influence of or- 
ganisational factors on routine outcome measurement in 
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practice. Low organisational priority and support for out- 
come measurement were identified as barriers in six 
papers [22,24,26-28,32]. Two papers indicated that hav- 
ing a high level of organisational commitment and sup- 
port for routine outcome measurement facilitated their 
use [23,32]. Co-operation of colleagues [21] and the sup- 
port of management [32] were also recognised as facili- 
tating routine outcome measurement. Concerns about a 
lack of management support [32], inappropriate use of 
outcome data by managers to reproach staff [21,32], and 
the imposition of measurement tools by management 
were all cited as barriers to their use in practice [30]. At 
an individual level, clinicians appear to be more positive 
about outcome measurement when they have a choice 
over the selection of outcome measures which they con- 
sider to be the most useful or meaningful to their prac- 
tice [23]. 



Practical considerations 

This theme relates to practical issues and considerations 
relating to the use of routine outcome measurement in 
practice. Time was identified as an important influencing 
factor in ten papers. The barriers associated with lack of 
time involved not only the amount of time required for 
both patients and clinicians to complete an outcome 
measure [7,22,25,28], but also the number of patients 
seen by a clinician [24,31] and institutional restrictions 
which may limit the amount of time available to spend 
with patients [24]. Time was not considered in isolation, 
but in association with the clinicians' assessments of suit- 
ability of a measure to their required context and the 
number of measures required [21,29,31]. Eleven papers 



[7,9,22-28,30,33] identified a lack of appropriate or avail- 
able outcome measures as a barrier to their use. An out- 
come measure that was appropriate to the context, could 
be practically applied and did not require too much time 
to document [31] was recognised as increasing the 
chances of being used in practice [30,31]. Lack of fund- 
ing or excessive costs of outcome measures [21,22,24,28- 
30] were clearly recognised as being barrier to their use. 

Patient considerations 

This theme relates to clinicians' concerns about using 
outcome measures with and for their patients. The rele- 
vance of outcome measures to practice is of clear con- 
cern to clinicians. Six papers discussed how outcome 
measures which did not inform their practice were a bar- 
rier to their use [7,22,23,30,32,33]. Clinicians reported 
that information provided by outcome measures were 
too subjective or not useful to their practice [30,31,33], 
and that they do not help to inform or direct patient care 
[22,32]. Conversely, the opinion that outcome measures 
could support patients' understanding, facilitate dis- 
charge planning, communication and treatment manage- 
ment [32], and the opinion that they provide the ability 
to make comparative clinical assessments [21] were likely 
to increase their use. This 'fit' of outcome measurement 
to routine practice was highlighted in five papers 
[7,21,24,29,32]. Three [21,24,32] identified that when 
there is a poor 'fit! barriers arose at both individual and 
organisational levels. 

Two papers highlighted clinicians' philosophical con- 
cerns about the relevance of standardised outcomes 
[30,31]; such concerns, however, were not found to be 
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statistically related to outcome measure use [22]. Five 
papers reported clinicians' concerns about their patients' 
ability to complete outcome measures [21,22,24,30,33]. 
These included the belief that measures: could be too 
complicated to be completed independently [22,24]; were 
confusing [22]; required a reading level was too high 
[22]; presented language barriers for patients not fluent 
in English [22]; presented ethnic and cultural sensitivity 
issues [22,30]; and that patients may become disheart- 
ened if they viewed their progress as slow based on the 
outcome measurement findings [22]. Such perceptions 
were reported to decrease clinicians' likelihood of using 
outcome measures in practice. Two papers, however, 
reported facilitating factors relating to patient considera- 
tions. Routine outcome measurement was viewed more 
favourably if they were easy for a patient to understand 
[22] and if patients did not find the measure to be too 
time consuming [21]. 

Discussion 

Routine outcome measurement has been strongly man- 
dated for within the allied health professions for at least 
the last twenty years [34]. Whilst in times of economic 
growth and service expansion such measurement was 
generally perceived as optional, this is no longer the case. 
Embedding outcome measurement into routine practice 
is now essential in order to meaningfully communicate 
patient progress, promote efficient treatment planning, 
and demonstrate service impact and efficiency. This re- 
view investigated research examining the facilitators and 
barriers to routine outcome measurement in practice. 
The 15 included papers identified key factors in the lit- 
erature. Information about these factors was systematic- 
ally extracted, analysed and synthesised. The quality of 
the papers included in this review was mixed. Future 
papers in the field should be clearer about their analysis 
to aid readers' understanding and interpretation. Despite 
this several different issues relating to the uptake of rou- 
tine outcome measurement in practice were highlighted. 

Achieving routine outcome measurement in practice 

Achieving routine outcome measurement in practice is 
challenging. As the collection of data usually occurs at 
the level of individual clinicians, it is natural to assume 
that this is where the 'fault' lies when routine outcome 
measurement is not achieved. The findings of this review 
suggest that this assumption should be questioned. 
There appear to be multi-level determinants to ensuring 
successful routine outcome measurement in practice 
[21,23,30,32]. Action is therefore required by organisa- 
tions, teams and individuals if routine outcome measure- 
ment is to be achieved. 

Organisations can increase the likelihood of successful 
routine outcome measurement by providing appropriate 



training, sufficient administrative support and adequate 
allocation of resources. Wherever possible the choice of 
outcome measures should not be organisationally 
imposed: external imposition of measures may inhibit 
their uptake [30]. This, however, is not always possible. 
Organisationally imposed outcome measures enable 
benchmarking both within and across services. Where 
external imposition of outcome measures does occur, 
organisations should consider developing mechanisms to 
overcome foreseeable barriers such as increasing com- 
munication to explain the rationale for compulsive meas- 
urement and increased education and training to 
counter the foreseeable resistance they will meet. Finally, 
organisations should carefully consider how they deal 
with sub-standard performance: a punitive approach to 
poor outcomes is likely to result in decreased measure- 
ment, not increased performance [21,32]. 

Teams should give priority to outcome measurement 
in practice. Sufficient time should be allocated to enable 
outcome measurement to occur. Several barriers were 
noted in the findings about the practical and patient con- 
cerns participants had relating to outcome measurement 
in practice [7,21,22,24,25,28,30,33]. Many of these could 
be addressed at a team level through a positive team cul- 
ture and ethos of evaluation. 

Clinicians too must take personal responsibility to en- 
sure that they collect data to help them evaluate patient's 
progress and their practice. The review highlighted two 
factors that appear to differentiate clinicians in respect of 
their attitude towards outcome measurement: those who 
worked in a clinical speciality and Higher Degree educa- 
tion [22,30]. It may be that there is a relationship be- 
tween these factors that differentiate these individuals 
from others within their professional group. But both 
present challenges in the endeavour to achieve routine 
outcome measurement: personal interest cannot be 
imposed; and Higher Degree education is not currently 
mandatory within the allied health professions in the 
UK. However, for some professions this is the case else- 
where [35]. If the organisational and the team levels are 
supportive of routine outcome measurement in practice, 
then research in related fields [36,37] provides good em- 
pirical and theoretical reason to believe that the resultant 
social normative pressure will result in individual clini- 
cians becoming more interested in collecting this data 
too. Knowledge of the clinician level factors that influ- 
ence routine outcome measurement data collection may 
also be useful for managers when considering the profile 
of staff they wish to employ. 

Strengths and limitations of the review 

This is the first time that a study has been undertaken to 
synthesise the key issues affecting routine outcome 
measurement exclusively in the Allied Health 



Duncan and Murray BMC Health Services Research 2012, 12:96 
http://www.biomedcentral.eom/1 472-6963/1 2/96 



Page 7 of 9 



Professions. Systematic, transparent and rigorous meth- 
ods were employed to gather and synthesise the available 
research and suggest areas of further investigation. The 
findings, however, must be interpreted with some cau- 
tion. The databases that were selected were done on the 
basis of their quality and potential for indexing relevant 
journals. Further databases could have been included, 
but we were required to balance our desire for a compre- 
hensive review with the high number of studies retrieved 
and the diminishing returns gained from searching mul- 
tiple databases with high degrees of duplication. The 
considerable duplication in studies retrieved between 
databases gives a degree of confidence that the main 
papers that are indexed have been included within this 
review. There is a risk of bias arising from the fact that 
only English language articles were included and confer- 
ences proceedings and the grey literature were not 
searched. A randomly selected proportion of papers, 
double-coded to check for accuracy of paper inclusion, 
showed perfect agreement between the authors. Whilst 
this indicates that the inclusion criteria and paper sec- 
tion process was being closely adhered to, it is impossible 
to be absolutely certain that no errors were made at this 
stage. The quality of the included papers was mixed. 
Some papers were unclear about their sampling and 
power analyses were rarely reported; more detailed stat- 
istical analyses would have enabled a greater in-depth 
understanding. 

In addition, only three different groups of allied health 
professionals were represented: physiotherapists, occupa- 
tional therapists and speech and language therapists. The 
included studies reported both clinician and managerial 
perceptions. No attempt was made to categorise facilita- 
tors and barriers according to differing staff groups. 

While a systematic process of searching for papers was 
followed, only seven of the 15 studies were identified via 
the search strategy, with the remaining eight being found 
via hand searching of reference lists. Developing the 
search strategy was a complex task that required consid- 
erable piloting to balance search sensitivity (ensuring 
that all relevant papers were being retrieved) with search 
specificity (ensuring that the papers that were retrieved 
were relevant). During the development of the search 
strategy, the various terms used to describe outcome 
measurement (e.g., outcome measurement, outcomes, 
standardised assessment, outcomes assessment) were 
considered, and a very broad search strategy was initially 
piloted. However, this returned more than 10,000 poten- 
tial papers. The first ten returned pages of each of the 
three electronic databases were assessed and the fit of 
the papers based on title review were extremely poor: 
only one paper in a list of 30 returned pages was a pos- 
sible fit. To refine the outcome measure search filter 
published search strategies on outcome measurement, in 



high quality publications, were then considered. Gilbody 
et al.'s [18] published search strategy on outcome mea- 
sures was chosen as it appeared to fit extremely well with 
the aims of the current review. Their search strategy was 
then adapted to fit with the broader range of health pro- 
fession groups that were targeted in the current review. 
The facilitators and barriers search filter was developed 
through a series of iterations and remained very broad, 
to capture as many prospective papers as possible. After 
examining the titles of the 15 included papers in the 
current review, we acknowledge that it may be the case 
that the outcome measure search filter could have been 
broader still, as numerous titles within the papers found 
via hand searching either did not contain any reference 
to outcome measurement (thus would logically have 
been missed in a broader search too) or used a much 
more generic term (e.g., standardised assessment) 
[8,25,29,33]. We did not include a search filter for stan- 
dardised assessment as this has a very wide usage in 
many disciplines, from outcome measurement in health 
care to testing genetic disorders to personality assess- 
ment. Inclusion of standardised assessment as a search 
term would have resulted in an unmanageable number 
of paper returns, and the number of new, relevant papers 
would have been proportionately low. Through our add- 
itional hand searching of reference lists we feel that we 
have identified the relevant papers in the field that are 
currently published that our original searches missed. 
We therefore feel that while the sensitivity of the search 
strategy may have been an issue, the relevant papers to 
the review's aims have been identified sufficiently. Finally, 
this review drew no data from grey material or confer- 
ence proceedings. It is certainly possible that further data 
could be present in these sources and there is the poten- 
tial for publication bias in our findings; however it was 
necessary to draw some boundaries around the inclusion 
criteria for the study and as a minimum quality standard 
we decided to only include papers that had been subject 
to peer review. 

While the aim of the study was to investigate the facili- 
tators and barriers to the routine use of outcome mea- 
sures in practice, it is clear that many of these factors are 
bi-directional and can be viewed as either a barrier or fa- 
cilitator depending on the emphasis given. With one ex- 
ception 14 , the literature included within the review 
overwhelmingly sought to uncover the barriers to rou- 
tine outcome measurement; considerably less emphasis 
was placed on discovering the facilitators. This may have 
led to important issues remaining undiscovered. 

Further research 

While the current review's findings appear relevant to al- 
lied health professional groups other than those included 
in the review findings, Wylie and Gallagher's [38] study of 
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transformational leadership identified that some of 
these groups are more inclined towards embracing 
change and modernisation than others: procedurally 
driven groups (e.g., radiographers and podiatrists; 
professions where procedures are often 'medical' in 
nature) are less likely to demonstrate transformation 
behaviours (e.g., motivation, intellectual stimulation, 
individualised consideration and behavioural and per- 
ceived charisma) than the more therapeutically focused 
groups (e.g., occupational therapists, physiotherapists). 
None of the former groups were included in this study's 
findings. Further research is therefore warranted to inves- 
tigate what, if any, impact these issues have on routine 
outcome measurement in practice. 

This review gave no consideration to the environment 
in which data was being collected. Investigations of pos- 
sible differences to routine outcome measurement in in- 
patient, outpatient, and domiciliary environments would 
be informative; whilst a number of key facilitators and 
barriers are shared; it is likely that there will also be var- 
iations between settings [21]. 

Almost all of the research to date has investigated staff 
perceptions of the barriers and facilitators of outcome 
measurement in practice. Only one paper [30] was 
included in this review which investigated whether the 
reported factors were associated with actual behaviours. 
It found that the perception that clinicians viewed 
patients as individuals and did not wish to 'group' or 'cat- 
egorise' them through the use of outcome measurement 
was not statistically associated use of outcome measures 
in practice [30]. Clearly the association between the 
other factors reported in this review and actual behav- 
iour should be studied in greater depth. This will enable 
both researchers and practitioners to identify which fac- 
tors have greatest weight in predicting routine outcome 
measurement behaviours; which in turn will facilitate the 
development of interventions with a good theoretical 
and growing empirical basis to support routine outcome 
measurement in practice. 

Conclusions 

The current review identified 15 studies that discuss the 
barriers and facilitators to routine outcome measurement 
by allied health professionals in practice. To date, the 
reasons for a lack of routine outcome measurement in 
allied health professionals' practice have been focused at 
the level of individual clinicians. The findings of this re- 
view highlight that such an approach is likely to be insuf- 
ficient: multi-level determinants may impact on the 
success or failure of routine outcome measurement in 
practice. There is an urgent need to investigate the asso- 
ciation between the multi-level factors reported in this 
review and actual behaviour. This would enable the de- 
velopment and testing of theoretically driven evidence- 



based interventions to improve routine outcome meas- 
urement related behaviours in practice. 
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